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Abstract 

In this article, it is proved that for any probability law fi over M with well defined expected 
value and a given deterministic time i > 0, there exists a gap diffusion with the prescribed law at 
the prescribed time. 

The method starts by constructing a discrete time process X on a finite state space, where 
Xt has law n, for a geometric time r, independent of the diffusion. This argument is developed, 
using a fixed point theorem, to give conditions for existence for r an independent time with negative 
binomial distribution. Reducing the time mesh gives a continuous time diffusion with prescribed law 
for T with Gamma distribution. Keeping E[t] = t fixed, the parameters of the Gamma distribution 
are altered, giving the prescribed law for deterministic time. An approximating sequence establishes 
the result for arbitrary probability measure over M. 

1 Introduction 

1.1 The Result and Method of Proof 

In this article, it is proved that for any probability measure over M such that Jj^ \x\^{dx) < +oo, 
with expectation denoted eo(/u) = J^xfi{dx), there exists a gap diffusion X in the sense of Kotani 
Watanabe |10| and Knight |11| . such that when Xq = eo(/i), 'C(A() = /i (where C denotes 'law'). That 
is, the probability measure fi is the law for the random variable Xt, the location of the process at a 
specified fixed time t > 0. The article proves existence; no claims are made about uniqueness, although 
the method of proof indicates how a solution may be approximated. 
The proof proceeds in five steps: 

1. Discrete time and finite state space are considered; conditions under which a suitable Markov 
chain with a given distribution when stopped at an independent geometric time are established 
(theorem 12.51 proved in section [3]). The solution, when it exists is unique and the construction 
is explicit. 

2. This is then extended to establish conditions under which there exists a Markov chain with a 
given distribution when stopped at an independent negative binomial time. This uses the fact 
that a negative binomial variable is the sum of independent identically distributed geometric 
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variables and uses a fixed point theorem (theorem 12.61 proved in section |4]). The extension from 
geometric to negative binomial times, proved in section 31 is the crux of the article. 

3. The independent time r ~ NB{r,a) has expectation E[r] = jy^' {xii'^)n>o denote the 
discrete time chain such that has the prescribed terminal distribution. A piecewise constant 
process {Y^'^'^^)t>o is constructed, where Y^'^'^'^ = xii"^ . Let T = tS, then Y^""'^^ has the prescribed 
distribution. The parameter a '[ 1 and 5 is chosen such that (jzfy = t- It follows that E[T] = t 

and V(r) = t^^ + |)'^^^ 0. For fixed r, as 5 — > 0, the distribution of T converges 

to a r(r, ^) distribution, while Y^""' ' converges to a continuous time Markov process on 
the discrete state space, with the prescribed terminal distribution at the independent gamma 
distributed time T (theorem 12.71 proved in subsection 15. ip . 

4. The limit r +oo is now taken; T converges to t in probability, while Y^^^ converges to a 
continuous time Markov process on a discrete state space with the prescribed terminal distribution 
at time t. (theorem 12.81 proved in subsection 15. 2p . 

5. Finally, arbitrary state space is considered. The target measure ^ is approximated by a sequence 
of atomised measures where the size of each atom is either approximately the size of the 
atom of fi at that point, or approximately ^ if /i has no atom at that site. The sites of the atoms 
define a finite state space and the previous arguments show existence of a gap diffusion y^") with 
marginal distribution /i^") at a prescribed time t > 0. An example shows how continuous time 
Markov chains on finite state space can be described in the language of gap diffusions. Large n is 
considered and, by taking subsequences, it is shown that there exists a string measure m* and a 
corresponding gap diffusion process, which has marginal distribution = lim„^+oo A*^"^ at time 
t > 0. This is the content of theorem 12.91 which is proved in sections [6] and [71 the first of these 
to set up the background from Krein strings, the second of these to prove the result. 

1.2 Background 

The problem of constructing a gap diffusion with a given law with compact support at an independent 
exponential time has been discussed fully by Cox, Hobson and Obloj in [2j. The problem of constructing 
a martingale diffusion that has law ^ at a fixed time t has been solved by Jiang and Tao in jS] under 
certain smoothness assumptions. 

Recently, Martin Forde in [7] extended the work of Cox, Hobson and Obloj [2j to provide a process 
with prescribed joint law for the process at an independent exponential time r and its supremum over 
the time interval [0, r]. The approach taken by Forde uses the correspondence between the resolvent and 
the distribution of the process stopped at an exponential time. The argument requires the probability 
measure to have a strictly positive density / on the region R = {{y,b) € R^|y ^ b,XQ < b < +00} 
where y denotes the process value at the exponential time and b the value of the supremum over 
the time interval and xq = yfiv, b)dydb. The argument is involved, but it should be possible to 

a) consider the analagous discrete time processes on finite state space stopped at geometric times, 

b) reduce the time discretisation to obtain continuous time process on finite state space stopped at 
exponential times (and thus relax the condition on the density being strictly positive), c) apply a 
similar fixed point theorem described here to extend the result to negative binomial times for discrete 
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time steps and gamma times for a continuous time and d) hence take a limit to obtain an existence 
result for deterministic times on arbitrary state space. The approximating procedure to obtain the 
general result should be possible. This is a large agenda and the argument by Forde is already involved, 
but the key ingredients and the role of the resolvent in the proof make the agenda outlined above look 
possible. 

Since writing this article, the author was made aware (on 19th May 2011) of a work dated 9th May 
2011 submitted, but unpublished at the time of writing, by Ekstrom, Hobson, Janson and Tysk |^, 
that solves the problem in a different way. The article [6] also approximates the target distribution 
by atomic measures, but appeals to general results from algebraic topology to conclude existence of a 
limit. 

In |14) . Monroe constructs a general symmetric stable process with a prescribed marginal at a fixed 
time, but does not require that the resulting process has the martingale property. 

It is hoped that the method presented here, although it only proves existence, may provide the 
basis of a construction in cases of interest. The key to existence is showing that there exists a point 
that satisfies a system of polynomial equations and there are reasonably efficient numerical methods 
available for locating solutions to such systems of equations when they are known to exist. The 
discussion in the conclusion indicates the further work necessary if this is to be developed into a 
computationally efficient method. 

1.3 Motivation 

The subject of strong Markov processes generated by Krein- Feller generalised second order differential 
operators is of great interest in its own right. More specifically, the inverse problem, of computing a 
string m to give a solution / to the parabolic equation ^ = with prescribed initial condition at 

t = and prescribed behaviour at t = T > is a long standing problem, of interest in mathematical 
physics. 

In recent years, the interest in the problem has been strongly renewed by applications to the field 
of modelling financial markets. Since this is the current driving force for this problem in the applied 
literature, the financial motivation will be discussed here. 

The general motivating problem within finance is that of automating the pricing and risk manage- 
ment of derivative securities. More specifically, it is the problem of pricing a wide of European style 
options given the current market price of the underlying asset and market option quotes of European 
call options at a range of strikes K for a term t or, more generally, several terms. Here the problem of 
providing a process that meets a single smile is discussed, but the method could be extended relatively 
easily to provide a piecewise time homogeneous process that meets given smiles at terms t]^, . . . , t^i. 
The problem of constructing a process to facilitate option pricing is discussed by Peter Carr in [3j, who 
develops a suitable model, known as the local variance gamma model. This is a problem of practical 
importance; from listed option prices, the problem of inferring option prices at non-listed strikes and 
terms arises both on exchanges and with over-the-counter transactions. The problem of determining 
the appropriate inputs for a model so that the output is consistent with a specified set of market prices 
is known as calibration. 

One of the simplest examples of a calibration procedure is the computation of the implied volatility 
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from the Black Scholes formula. From a single option price, the volatility input for the Black Scholes 
model is computed, so that pricing is consistent with the given market price. When several prices 
are given, each with a different maturity, the instantaneous volatility can be considered as a piecewise 
constant function of time, which jumps at each option maturity. When different strikes each with the 
same maturity are considered, the implied volatility smile makes it difficult to extend the Black Scholes 
model in a straightforward way to deal with the set of information. 

Several ways have been suggested to deal with the fact that the implied volatility at a single 
term is not constant as a function of the strike price and there are many ways to construct a model 
that is consistent with a given set of arbitrage free market option prices. One approach is found in 
Rubinstein |16) . which presents a discrete time model, where the price process is a Markov process on 
a binomial lattice. A continuous time and state version of Rubinstein's model can be found in Carr 
and Madan [1]. Madan and Yor |13j give an alternative way to construct a martingale diffusion that 
is consistent with a volatility smile. 

The approach of Peter Carr in |3] is essentially different; the resulting risk neutral process for 
the price of an asset underlying a set of European options designed to meet a single smile is a time 
homogeneous process, which is not a diffusion. It is based on a driftless time homogeneous diffusion, 
which is run on an independent gamma clock. That is, if X denotes the driftless time homogeneous 
diffusion, then the stock price process S is given by Sr = X-p^ where F is an independent gamma 
subordinator. A subordinator is a one dimensional Levy process which is increasing almost surely; for 
a gamma subordinator, the Levy process is a gamma process. The gamma clock is normalised so that 
F^ has an exponential distribution, where t is the maturity of the options whose prices are given or 
observed. 

This article considers the situation where, for a single fixed term t, the European call option, or 
put option, prices are listed over the whole range of strikes K and shows existence of a risk neutral 
measure under which the stock price process evolves according to a martingale diffusion where the 
distribution at time t is that defined by the data. 

2 Definitions and Results 

2.1 Markov martingale random walks and gap diffusions 

The following processes will be used in the article. 

Definition 2.1 (Discrete time Markov martingale random walk on a finite state space). A discrete 
time Markov martingale random walk (henceforth referred to as a DMRW) on a finite state space 
S = {zi, . . . jZm} C M with ii < 12 < ... < iM is a martingale that is a time homogeneous Markov 
process with a one step transition function P with entries Pj^^ = ^{Xt+i = ik\^t = ij) that satisfy the 
following conditions: there is a q = (qi, . . . ,qM) G {0} x [0, 1]^^^^ x {0} (taken as a row vector), that 
is qi = qm = 0, such that 

1. 

Pjj = l-qj, 0<q,<l jG{l,...,M} 
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2. For each j € {2, . . . , M - 1}, 

- ir- -■ ' - Ij-- -■ — ■ 

5. // A: ^ {j - + 1}, then Pj,k = 0. 
4- For each j £ {2, . . . , M} and each y € 

¥{Xo+ = ij\Xo = y)= ^ ~ ''-^ P(Xo+ = ij-l \Xo = y) 



"J I - - , _ , - . . . - - , _ 

ij Ij-l Ij ij-i 

That is, if the initial value y of the process is not in S, then the process immediately jumps 
(at time 0) to the value max{x € S\x < y} or the value min{a; G S\x > y}, with probabilities 
determined to ensure that the process is a martingale. 

Notation The following notation will be used: 

(^j,j+i = -^ -■ «jj-i = -^ aj,k = kj^j±l (1) 

Note that for each j G {1, . . . , M}, Xifeli Pjk = 1- 

This is a random walk with state space S whose transitions are only to nearest neighbours in S. 

Definition 2.2 (Continuous time Markov martingale random walk on a finite state space). A con- 
tinuous time martingale random wa\k (henceforth referred to as a CMRW) on a finite state space 
S = {ii, . . . ,iM} C M with ii < . . . < iM is a martingale that is a time homogeneous Markov chain 
that satisfies the following: there exists a A = (Ai, . . . , Am) G {0} x M^~^ x {0} (taken as a row vector 
with Ai = Am = 0) such that 

1. 

^{Xs+r = ij V < r < t I Xs = ij) = e~^^* Vt > j = 1, . . . , M 



2. 



r lim,,_,o rfiXt+h = ij+i\Xt = ij) - iT^^=i-i^^3 
\ lim,_,o }AX,^n = ij-i\Xt = ij) = j^'^Xj Vj = 2, . . . , M - 1 

3. For each j € {2, . . . , M} and each y € {ij-i,ij), 

P(Xo+ = ij\Xo = y)= nXo+ = ij-i\Xo = y) = . ^ • 

ij ij-i ij ij-i 

Notations The following notation will be used throughout: 

1. B denotes the a algebra of Borel sets. 

2. For a measure u, defined over B{R), or the Borel sets of a subset of M, an atom at a point x G 
is denoted by u{{x}), where {x} denotes the set containing the single point a; G R. 
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Definition 2.3 (Continuous time gap diffusion on a continuous state space). Let W{.,x) denote a 
standard Wiener process, with initial condition W{^,x) = x. Let {<j)^^\t,z) : t > 0, z G R} denote 
the local time ofW{.,x) Recall, for example, Revuz and Yor }15^ chapter 6) that is jointly 

continuous and that lA{W{r,x))dr = 2 J^(j)^^''{s, z)dz for every A C ,B(R). 

Let m* denote a measure over R, such that for two points Lq < Li, possibly Lq = —oo and possibly 
Li = +00, m*{{a,b)) < +oo for all Lq < a < b < Li, — oo < a <b < +oo, m*({Lo}) = m*({Li}) = 
+00, m*((— oo, Lq)) = m*((Li, +oo)) = 0. 

Let T{x, s) = /jg (l)^^\s, z)m*(dz) and let T^^(x, s) denote the inverse function of s ^ T{x, s). Let 

X{s,x) = W{T~'^{x,s),x). (2) 

Then X defines a strong Markov process on [Lq, Li] such that '¥'[XtJ^s = LQ\Xt = Lq) for allt>0 and 
alls>0 and F{Xt+s = Li\Xt = Li) = I for all t > and all s>0. 
The process thus defined is the gap diffusion associated with m* . 

The definition is found in Kotani and Watanabe |10) page 245. The terminology gap diffusion to 
describe such a process was first introduced by F. Knight. At approximately the same time, S. Kotani 
and S. Watanabe introduced the terminology generalised diffusion to discuss the same type of process. 
The reader is referred to F. Knight and S. Kotani and S. Watanabe |10| for details. 

Kotani and Watanabe in |10) develop the characteristic function, various properties and use it to 
study properties of generalised diffusions. Knight in considers the local time of the gap diffusion 
and characterises the set of Levy processes that can be obtained by varying the speed measure m* . 

2.2 Results 

This subsection describes the main results for proving existence of processes with prescribed terminal 
behaviour. Conditions under which a DMRW (definition 12. ip may be constructed, with prescribed 
distribution when the process is stopped at an independent geometric distribution are given. The 
construction is shown and the solution, when it exists, is unique. This is the content of theorem 12.51 
The quantity J- defined in definition 12.41 appears in the explicit formula for the parameters q for the 
DMRW with required terminal distribution at an independent geometric time given by equation (j6]). 
When q E {0} x [0, 1]^^^^ x {0}, equation 1^ provides the unique solution to the problem; if not, then 
there is no solution. 

Next, the result is extended to show conditions guaranteeing existence of a DMRW with prescribed 
behaviour when stopped at an independent negative binomial time. This is the content of theorem 12.61 
This is used to show that there exists a CMRW fdefinition l2.2p with prescribed behaviour when stopped 
at an independent time with Gamma distribution. This is the subject of theorem 12.71 By taking an 
appropriate limit, so that the coefficient of variation goes to zero, a CMRW with prescribed behaviour 
at a deterministic time is obtained. This is the subject of theorem 12.81 By considering the cumulative 
distribution function in the general case as the limit of cumulative distribution functions of variables 
with finite state space, the general result, existence of a gap diffusion with a prescribed law at a fixed 
time is obtained. 



6 



Definition 2.4. Let p = (pi, . . . ,pm) (taken as a row vector) be a probability mass function, that is 



Pj > for each j G {1, • • • ,M} and X^jliPj = 1- Let S = {ii, . . . ^iu} C M, ii < . . . < iu be the 
support of the probability mass function and eo{p), or simply cq when it is clear which expectation is 
meant, denote its expected value; 



M 



eo{p) = eo = ^ijPj- 



Let I denote the coefficient such that < cq < ii. Set 



and 



C{p,j) 



fe+i-^j-i) 





ELi(*i -ik)Pk 
T.k=j+Sk - ij)Pk 



2<j<l-l 
l<j<M-l 
j = 1 or M 



(3) 



J^ipJ) 







j &{!,..., M} when C{p, j) > 
je{l,...,M} when C{p,j)=0 



(4) 



Notation Throughout, eo will be used to denote the expected value of a probability distribution. If 
p = {pi, . . . ,pm) represents a probability mass function over a finite set {ii, . . . , }, then the notation 
Co or eo{p) will be used to denote eo(p) = X]jf=i hPj- If is a probability measure over R with a well 
defined expected value, then the notation cq or eo(/u) will be used to denote eo{fi) = J xfj,{dx). 



The following theorem is a discrete version of the first approach to the problem of finding a process with 
prescribed terminal distribution at an exponential time by Cox, Hobson and Obloj [2]. Exponential 
time is replaced by geometric time, which is its discrete analogue, and the argument is similar to the 
use of the resolvent in [2]. In the discrete setting, the argument is similar and boils down to showing 
that there exists a solution to a system of linear equations. Exploiting the idea that a diffusion at an 
exponential time could be computed explicitly by considering the resolvent (the approach presented 
below for geometric times) appeared earlier, in Peter Carr [3]. 

Theorem 2.5 (DMRW process at geometric time). Let r denote a random time with probability 
function 

I U otherwise 

That is T ^ Ge{a) (geometric distribution with parameter a). Let p = {pi, . . . ,pm) be a probability 
mass function, satisfying minj^^i j^jypj > 0. Let S = {ii, . . . ,«a/} C R, ii < . . . < iM (^nd suppose 
that p, taken as a probability mass function over S has expected value eo = eo(p) = '^jLi'^jPj ■ Let 
T be defined by equation Q). Then there is a DMRW X (definition \2. 1]) with state space S and one 
step transition matrix P as in the definition, where r is independent of X , such that for I satisfying 
ii-i < eo < ii, ii-i,ii G S, 

eo-z;-i jp^^^ ^ ^ .^^ ^ ii - eo ^ ^ ^ ^ 

n - ti-i n - H-i 

if and only if 
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max (- -l] T(p,k) <1. (5) 
k€{i,...,M} \a J - 

The components of vector q are given by 

i qj = Ca-^)Hp,j) je{2,...,M-i} 

\ qi = QM = 0- 

Proof of theorem 12.51 This is the subject of section [3l □ 

This is then extended, using a fixed point theorem (theorem 14. Sp . to negative binomial times. A 
negative binomial time may be regarded as the sum of independent identically distributed geometric 
times. For a NB{r,a) time (negative binomial, sum of r independent geometric times, each with 
parameter a), this boils down to showing that there is a solution to a system of polynomial equations, 
each of degree r. The fixed point theorem is required to give conditions under which there exists a 
solution. 

Theorem 2.6 (DMRW process at negative binomial time). Let S = {ii, . . . ,iM} C M. Let p = 
{pi, . . . ,Pm) be a probability mass function satisfying mmj^^i j^j-^pj > 0. Suppose that p is a proba- 
bility mass function over S, with expected value bq = eo{p) = "^jLi ^jPj- t be a random time with 
probability function 



p^{k) = P(r = k) 




aYa'^ A: = 0,1,2,... 

otherwise 



That is, T ~ NB{r,a) (negative binomial with parameters r and a). Let qi = qM = 0. Then there 
exists an oq G [0, 1) such that for each a G [qq, 1) there exists a q = {qi, . . . , qu) G {0} x (0, x {0} 
such that P{q) defined in definition {2^1 is the one step transition matrix for a Markov chain X with 
state space S, independent ofr, such that 



FiXr = ij\Xo = eo) = pj j = l,...,M. 

Proof of theorem 12.61 The fixed point theorem to enable the result of theorem 12.51 to negative 
binomial times, and the proof of theorem 12.61 are the subject of section |4l □ 

Aside Note that 

E[rl = -^=, VM = -^=„^(i + i) 

I — a (1 — a)^ \r ^ J 

where fj, is used to denote E[r] and V denotes variance. The idea is to consider time steps of length <5, 
where — t- 0, with a terminal time T = 5t, E[T] = t. Then 

E[T] = t, v(r) = t2 ("i + ^^ ^ f 0. 

\r t J r 
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□ 

The result of theorem 12 . 61 may therefore be extended to show existence of a CMRW (definition 12 ■2p with 
a prescribed distribution at a deterministic time t > 0. Formahsing the argument outhned above is the 
subject of theorems 12.71 and I2.8| theorem 12.71 gives existence of a CMRW with prescribed distribution 
at an independent gamma time, while theorem 12.81 alters the parameters, keeping the expected value 
fixed, to obtain a CMRW with a prescribed distribution at a deterministic time t > 0. 

Theorem 2.7 (CMRW process at gamma time). Let S = {ii, . . . ,iM} C M and let p = {pi, . . -Pm) 
(taken as a row vector) be a probability mass function over S, where min^gj]^ > 0- That is, 

^jLiPj = 1 o^i^d zero probability is assigned to x ^ S. Let eo = eo{p) = "^jLi '^jPj- t be a random 
time with probability density function 

/.(x) = ^0''x'-V-A x>0. 

That is, r ~ r(r, ;^), gamma distribution with parameters r and ^ where T denotes the Euler Gamma 
function, which for integer r > 1 is T{r) = (r — 1)!. For any integer r > 1 and any t > 0, t G R+, 
there exists a CMRW process X on S satisfying definition \2.S\ such that 

¥{Xr = ij\XQ = eo) = pj j = l,...,M. 

Proof of theorem 12.71 This is the subject of subsection 15.11 □ 

Theorem 2.8 (CMRW process at a fixed time). Let S = {ii, . . . ^iu} C M and let p = (pi, . . .pu) 
(taken as a row vector) be a probability mass function satisfying "caixij^^i j^i^pj > 0. Suppose p is a 
probability mass function over S and let eo = eo(p) = '^fLi'i'jPj denote its expected value. For any 
specified t > 0, there exists a CMRW process X with state space S satisfying definition \2.S\ such that 

¥{Xt = ij\Xo = eo) =Pj j = l,...,M. 

Proof of theorem 12.81 This is the subject of subsection 15.21 □ 

The final, and largest step is to take a limit and go from atomised probability measures with finite 
numbers of atoms to arbitrary probability measures over M. This is the subject of theorem 12.91 The 
proof of this theorem requires section [6] as preparatory material and section [7] to prove the convergence. 
While the steps are routine, a substantial quantity of analysis is necessary to take the limit. Lemma [7. II 
of section [7] uses the characterisation of Markov processes in terms of a time changed Wiener process, 
where the time change is given in terms of the local time and the string measure to show that if the 
strings converge appropriately, then the processes converge in a suitable sense. The task is therefore 
to prove that, given a suitable approximating sequence of atomised measures approximating the target 
measure, there is a convergent subsequence of strings with a well defined limit. Convergence is then 
considered in two parts; firstly, convergence of part of the strings to a measure that is absolutely 
continuous and convergence to the atomic part, corresponding to the atoms in the target measure. 

Theorem 2.9 (Gap Diffusion). For any probability distribution function fi defined on M such that 
\x\fj.{dx) < +00, let eo = f^^xfi{dx) denote its expectation. Let t be a fixed time t > 0. Then 
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there exists a string measure m* over M such that , , is the infinitesimal generator of a gap diffusion 



dm*dx 

X where 

F{Xt < x\Xq = eo) = oo,x]) Vx G (—00, +00). 

Proof of theorem 12.91 This is the subject of section [6] to define the machinery and section [7] to 
prove the convergence. □ 

3 Proof of theorem 12.51 

This section is devoted to the proof of theorem 12.51 giving conditions under which there exists a DMRW 
(definition 12. ip with a given distribution at an independent geometric time, together with an exphcit 
formula. The exphcit formula is of crucial importance in the proof of theorem 12.61 where the existence 
result is extended to negative binomial times. 

Firstly, if r ~ Ge{a) (Geometric with paramter a) independent of X, then 



00 

FiXr = ik\Xo = ij) = = ^k\Xo = i,MT = m) = (1 - a) ^ {aP)]^^ = (1 - a)(/ - aP{q))j^\ 

m=0 m=0 



where {aP)^ = a^P^ and P"* is taken in the sense of multiplication of matrices, so that if the process 
has initial distribution v_ at time 0+ and terminal distribution p at time r, then p = {\ — a)v_{I — 
aP{q))-\ 

The central part of the proof of theorem [23] is lemma [HTTl Lemma [3 . II gives an explicit computation 
for the parameters q such that p{I—aP{q)) = (1 — a)w for a specified measure p and a vector y_ specifying 
the probability distribution at time 0+; if eo(p) 5", the process jumps into space S at time according 
to the rules described in definition 12.11 which gives the vector v_. The system of equations is linear and 
has an explicit solution. The proof of theorem 12.51 is then a simple corollary. 

The quantity J- of equation @ definition 12.41 is of crucial importance in the whole construction; it 
turns out (lemma [3. ip that it is the explicit formula for the parameters q for the DMRW with required 
terminal distribution at an independent geometric time given by equation ([6]). 

Lemma 3.1. Let p = [pi, . . . ,pm) denote a row vector such that mmjPj > and 'Yl!k=iP3 ~ ^- ^ 
and T he defined as in definition \2.4\ ctj^k equation Let cq = eo{p) = '^jLi'^'jPj ■ Then there is 
a unique row vector q = (gi, . . . ,gAf) £ {0} x x {0} and matrix P{q) defined by 

PjAg) = ^-Qj j = l,...,M 
Pj,j-iig) = > J = 2, . . . , M 

= o^jd+ilj i = 1, • • • , - 1 
Pj,k = k^{j-lj,j + l} (j,A:) G {1,...,M}2 

such that for each a G (0, 1), if ii-i < cq < ii, then P satisfies 

j ^1-1,1 

ip{I-aPiq))), = { 1^(1 -a) j = l (9) 



(8) 
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The parameters q = (gi, . . . , qm) satisfy 



--l]T{p,j) je{l,...,M}. 

a - 



(10) 



Proof of lemma 13.11 From the definition of P{q) in equation ([8]), equation ([9]) may be written as 



pM = (1 - a)v 



(11) 



where 



M 



jj — 1 — a + aqj 



j = l,...,M 
aqjOjj+i j = l,...,M-l 
^IjO^jJ-i J = 2, . . . , M 

k^{j-l,jj + l} 



(12) 



and 



j^l 

eo-il-l n — I 



1,/ 



H-H-l 
k—H-l 



I - 1. 



Equation (lllh gives a linear system of M equations and M — 2 unknowns (^2, • • • , ^Af-i), but 

^(p(I - aP{q))j = "^Pkil - aP{q))kj = ^Pfc(l - a + aqj, - aqkak,k-i - aqk(^k,k+i) = (1 
3 jk k 

while '^jVj = 1. Furthermore, 

Y,i,{p{I - aP{q))j 
j 

= ^hPkiI - ci'P)kj = X]pfc(«fc(l - a) + aikqk - ik-iaqkOLk,k-i - aik+iqkak,k+i) 



jk 



k 

M-1 



(1 - a) ^ ikPk + a X] PkQk ( 1 - h-i 



k=2 



— ^k 
h+i — ik-l 



^k+1- 



^k — »fc-l 
ik+l — ik-l 



(1 - a)eo 



while 



E. eo - ii-i , . - eo 
IjVj =11- , 



H - H-1 



eo- 



It follows that there are at most M — 2 linearly independent equations with M — 2 unknowns and 
hence at most one solution. It is now shown that qj : j = 2, . . . , M — 1 given by equation pO|) provides 
a solution. 



Consider qi = qM = and q2, ■ ■ ■ , qM-i defined by equation ([TO]) . For 3 < j < / — 2, 
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J2Pk{I - aP{g))kj 
k 

= (1 - a)pj + (1 - a)Cip,j) - (1 - a)C{p,j - 1) - (1 - a)C{p,j + 1) 

1 ^'"^ 1 ^' 

-(1 - a)-— "^ih-i - ^k)Pk - (1 - a)-. — ^{ij+i - h)Pk 

^J-i k=i *-'+^ k=i 

j—2 

= (1 g) V f ^^^^^ ~ ~ "^^^ - ^J-^ ~ _ ^j+i ~ ^fc 1 



= 0. 

For 2 = j < Z - 2, 



Y,Pk{I-aP)k2 = il-a)p2 + il-a)Cip,2)-{l-a)C{p,3) 



(1 - a) [ jis - k){i2 - h) _ is - k \ ^ ^ 



For Z + 1 < j < M - 2, 



= (1 - a)p,- + (1 - a)C{p,j) - (1 - a)£(p, J - 1) - (1 - a)/:(p,i + 1) 

-(1 - a)-— ^(ife - - (1 - a)-. — XI (^fc ~ h+'^)Pk 

= (l-a) V [ fe+i ^fc-b-i ifc-ij+i l ^ 

I {ij+i - h)i}3 - k-i) ij-ij-i I 



= 0. 

For M - 1 = j > Z + 1, 
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J2Pk{I - aP)k,M~i = {l-a)pM-i + il-a)C{p,M-l)-{l-a)Cip,M-2) 
k 

= pA/-i(l - a) + (1 - a)- : — -pM 

{^M-l — iM-2)[lM — ^M-l) 



1 

-{I -a)- : {ik-iM~2)Pk 



k=M~l 



s{ (iM — iM-2){'iM — Hl-l) IM — iM-2 1 r^ 

= T- ■ — \r- — V ~ ~ — r = 0- 

L V-M — ^M-\)\}M-\ — ^M-2) «M-1 — «M-2 J 

For J = / -I, 2^f,^iikPk = eo gives }^k=l+i^kPk = eo-2^k=i^kPk and }_,k=iPk = 1 gives }_.k=l+iPk 
1 - Ei=i?'fc- Using this, 



k 

= (1 - a)p/_i + aqi^ipi^i - aqi_2Pi-2ai^2,l-i - aqiPm,l-i 
= {l-a)\ pi^i + . r yZik-i - ik)Pk 

^ 1-3 

—. — X^(^i-2 - ik)Pk 



k=l 



1 



eo - ^ ikPk - H + k'^Pk \ \ 
k=l k=l J J 



(1 - a <^ r : — + -. : — Pi + 1 + J- ^Tr ■ V Pi^'^ 



+PI-2 



H - il-2 H - H-2 



1-3 
+ ^Pk 



{k - k-2){k-i - ik) k-2-ik k-ik 



{I -a) 



k=l 

k - eo 



{k - k-i){k-i - k-2) ik-i-k-2) k-k- 



n - H-2 

as required. The computation giving 



Y^p,{I-aP)ki = {l-a)[^-^^\ 



k 

is similar. Lemma [3.11 follows . □ 

Proof of theorem 12.51 Let q = {qi, ■ ■ ■ Qm) £ {0} x (0, 1]^^^^ ^ |q| ^et P{q) be the matrix 
defined according to definition 12.11 Let X denote the discrete time Markov chain with one step 
transition matrix given by P{q) and transitions defined in definition 12.11 and let r denote a random 
time, independent of X, with probability function 
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p{t = k) = a''{l - a) A: = 0,1,2,... 

Let P denote expectation with respect to both the random walk and the independent time r. Then 
the matrix P{q) provides a solution if and only if for each j € {1, . . . , M} 



=F{Xr = ij\Xo = eo) (13) 

oo . oo 

= "°~''"^ 1 - a) T{{aP)% + -^^^^{1 - a) V((aP)'=)^_i,,- < eo < n 

^^-^'-1 fc^o fro 

where {aP)^ = a^P^ and, with P^ , multiplication is in the sense of matrix multiplication. Set 

oo 

G{q) = Y.{aP{q))\ (14) 

A;=0 

then G{q) is well defined for a G (0, 1) and satisfies 

G{I - aP) = {I- aP)G = I. (15) 
Therefore q provides a solution if and only if G{q) satisfies 



Pj = "I" ' (1 - a)Gij{q) + .""^ (1 - a)Q_i,,(g) j = l,...,M ii-i<e^<ii (16) 

n - n-i ii- ii-i 

]M-2 



It follows that q G {0} x (0, 1] x {0} provides a solution if and only if 



M 



^Pk{I - aP{q))k,j = < 



k=i 



eo- 



r(i-«) j = ^ 

-{I -a) j = l-l 



H-H-1 
il-k- 

j ^l-l or I 



if ii-i < Co < ii, S S. By lemma [3Tl this system of equations has a unique solution, given by 

equation ([6]). The unique solution satisfies q G {0} x (0, 1]^^^^ x {0} if and only if inequality ([5]) holds. 
The proof is complete. □ 

4 The fixed point theorem and proof of theorem 12.61 

In this section, theorem 12.61 is proved, establishing conditions under which there exists a DMRW 
(definition 12. ip which, stopped at an independent negative binomial time, has a specified probability 
distribution. 
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Description Central to the proof is that a negative binomial variable r ~ NB{r,a) is the sum of r 
independent geometric variables, each with parameter a. If r ~ NB{r,a), then 

oo 

¥{X, = ik\Xo = ij) = ^¥{Xn = ik\Xo = ijMr = n) 

n=0 

n=0 V / 

= {l-ay{I-aP{q))J^- 



where P"" is taken in the sense of matrix multiplication of the one step transition matrices. It follows 
that if V is the distribution of Xo+ and p is the target distribution, then 

p= {l-aYvil -aP{q))-\ 

If the process is started from point cq and cq S, definition 12.11 describes the rules for the first jump 
at time 0; v gives the distribution at time 0+. The system p{I — aP{q)Y' = (1 — a)^w is a system of 
degree r polynomial equations; existence of solution is not straightfoward, let alone uniqueness, or any 
explicit expression for the solution. This article limits itself to existence. Existence of an ao < 1 such 
that for all a G [ao; 1) there exists a suitable q is established as follows. The equation can be expressed 
as (1 — a)~^'''~^^p{I — aP{q)Y^^ = (1 — a)v{I — aP{q))~^. In order to use theorem 12. 5| it has to be 

shown that (l-a)-(^-i) T.j{p{I - aPiq)Y'^)j = 1 and T.jijW - aP{q)Y~^)j = eo{p)- 

This is the subject of lemma 14.11 Once this is established, it then follows, by theorem 12.51 that any 
solution q satisfies 

f g^. = (i-l)j-((l-a)-(^-i)p(/-aP(g)r-i,i) iE{2,...,M-l} 
1 j = l,M 

Existence of a range [ao, 1) such that for any a G [aO) 1) there exists a solution q is now essentially a 
fixed point theorem. Let A = (^i^^ Q- Then (1 — a)^^{I — aP{q)) = N{\) where the matrix is 
defined below. It follows that solutions satisfy A = J~{pN^^^{K)) and theorem 14.51 gives existence of 
A G {0} X R*^~^ X {0} that satisfies this equation, together with existence of a positive lower bound 
and finite upper bound for the components of the fixed point. It follows that q = — l) A provides a 
solution for a € [ooi 1) where oq satisfies — 1 ) maxj Xj = 1, so that g e {0} x [0, 1)^^-2 x {0}. 

Lemmas 14.21 and 14.31 are technical lemmas used in the proof of theorem 14.51 Lemma 14.21 by finding 
a probabilistic expression for the entries of the matrix N~^^~^^ (defined below) that appears in the 
proof of theorem 14.51 proves that the entries are non negative and that the rows sum to 1 . Lemma 14.31 
shows that for any p > 1, the rows of A^^ sum to 1. Lemma 14.41 deals with the columns of A^~^' for 
p > 1, showing that they tend to zero if the corresponding component of A goes to infinity. 

Let h{p,X) = pN^^^{X)j the notation used below. To construct a fixed point theorem, firstly the 
function h has to be modified to form a function fi'^^ where the entries are bounded from above and 
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(17) 



below to ensure existence of a fixed point for the modified problem. The difficulty is with letting e — )■ 
and showing that the components of A*-*^^ are bounded from above and also bounded from below by 
a constant strictly greater than 0, so that any limit point is a solution to the fixed point problem. 
Lemmas 14.21 14.3] and 14.4] play an integral part in this, their roles are described more fully below. 

Notations For A G {0} x M*^-^ ^ {o}, define the M x M matrix A^(A) by 

' iVjj = l + Aj i = l,...,M 

Njj^i = -Xjajj-i j = 2,...,M 
^j,k = otherwise. 

where aj^k is defined in equation ([1]). For an M-row vector b G R*^ and A G {0} x M^^"^ x {0}, define 
h = (/ii,...,/im) by 

h{b,X) = bN'^-\X) (18) 
Let P{q) be defined as in equation ([8]) and note that 

^ {I-aP{q))=N((-^)q]. (19) 



9i 



1 — a - \\l — aj — 

This is easily seen; 



^(/ - aP(,)),, = ^((1 - a) + aq,) = 1 + (^) 
^(/ - aP{q))jj_i = -ajj-i (^3^) 



1 -a 
It follows that 

The following lemma shows that when p is a probability (that is pj > for each i = 1, . . . ,M and 
^jLiPj = 1)) then for each A, the components of hip-,^) sum to 1 and ijhj{p,X) = ijPj- This 
means that if, furthermore, all the entries of h are positive, then it is a probability mass function. 
When taken over S = {«!,... , ^m}) it has the same expectation as p. 

Lemma 4.1. Let p be an M row vector that satisfies Pi > for each i G {1, . . . , M} and X]j=i Pj — ^■ 
Let eo{p) = X^jli "^jPji A £ {0} x M;!}:^^^ x {0} and let h be defined in equation [TE\). Then 

M 

Y^h,{p,X) = l (21) 
i=i 

and 

Y.iMp,X) = eoip). (22) 
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Proof For equation pTI) . let q = m) X ^ ^* ~ '^i ^^'^ ^ ~ i+x* ' ^° ^'^^^ 

= A- Using equation (j20|) . 

M ^ M r-l / \ M 



j=l ' ' k=l i=0 \ / j=l 



1 - a 



For equation (I22|) . let Xj denote the position at time i of the Markov chain with one step transition 
matrix P given in definition (j2.ip determined by q and recall that X is a martingale, so that 



E[Xi\Xo = ik] = ik- 

Then, defining a and q as above. 



M MM r-l / ^ 

j=l ^ ' j=l k=l 1=0 



1 


(1 






1 


(1 


-ay-^ 




1 



M r-l / , 

X - V - , , . / r — 1 



a'E[Xi\Xo = ik] 



k=l i=0 
M r-l 



(1 -a)^-i ^ ^"'^^^ 

^ ^ A:=l i=0 

M 



I I 

r - 1 
i 



^ikPk = eo{p). 



k=l 

□ 

The following lemma gives a useful representation of p in terms of h and gives useful properties of 
the inverse A^~^ that will be used later. The crucial properties are that elements of A^~^ are all non 
negative and each row sums to 1, giving control on the entries. The characterisation of equation (l23l) 
will be used in the following way: if a < 1, then E[r(a)] < +oo. If qj = for some j, then Pjj = 1 and 
P(X^((j) = imi\XQ = Zmj) = for mi < j < m2 or mi > j > m2, which will be used to show that a 
contradiction is obtained if A^"^^ 0, the contradiction being that the process cannot get past site j. 
The fixed point theorem 14.51 starts by finding a fixed point A^*^^ to an approximate equation and then 
the limit e — )• is examined. It is shown, using equation (|48p and lemma 14.21 that miuj A^^ > for 
any limit point A*-"-*. 

Lemma 4.2. Letr > 2. Letp = (pi, . . . ,pm) be a probability mass function satisfying inf j^^i j^f-^ pj > 
0. Recall that h{p,X) = piV''"^(A) where N is defined by equation (Q^j. Let A G {0} x M^^"^ x {0}. Let 
A* = supj Xj and let ao = j^j^- For any a € [ao, 1), let r(o) denote a random time with probability 
function 

P(r(a) = A;) = (1 - af -1 f ''"^^^ j k = 0,l,2,... 
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and let X denote a DMRW (definition \2.1\) . where the initial transition at time and subsequent one 
step transitions are defined in definition ] 2. 1\ independent of T{a), with parameter vector q = — l) A. 
Then 

(iV-('-i)),fe = P(X,(,) = ik\Xo = ij). (23) 

It follows that (A^^^''""^^)j,fc > for all A G {0} x M^^"^ x {0} (that is X2, ■ ■ ■ , Xm-i all strictly positive) 
and that 

J^(iV-i),fc = 1 VjG{l,...,M}. (24) 
k 

It also follows that 

M 

Pk = Yl A)lP(^r(a) = ifcl^O = ij). (25) 

Proof For such a choice of a and q, it fohows from equation (fTUI) that 

Ar-(-i)(A) = (l-a)^-i(I-aP(g))-('^-i) = (l-a)'-if;( "^"J^^ ] {aP{q)f 



k=o \ ^ / 
so that 

N-t;n'^{\) = (1 - E ( ' " ^ ) ^'^^^^ = = i^,) (26) 

and equation (j23p fohows from the definition of T(a); equation (j24p fohows from summing over m2 in 
equation (|26p . It fohows from the definition of h given by equation (|18p that 

p = /i(p,A)iV~(''^i)(A) 

and hence that, for /c G {1, . . . , M}, 

= (l-a)^-i^ " + ' a*E^(^'A)(n.,fc 
i=o V ^ / i=i 

= (l-a)'^-!^ a*j;/i,(p,A)P(X,=ifc|Xo = i,) 

i=o \ ^ / j=l 

M 

= Y. A)IP(^r(a) = 4 1^0 = ij) 

thus estabhshing equation (I25p and completing the proof of lemma 14.21 □ 
Lemma 4.3. For all r >1, '^j{N'^)k,j = 1 for each k. 
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Proof By construction, this is clear for r = 1; 

_ f -QA:,fc-lAA: + (1 + Afe) - afe.fc+lAfc = 1 G {2, . . . , M - 1} 
Y ~ I 1 A:G{1,M} 

For r > 2, assume that the result is true for r — 1, then 

j i,j i 

The result follows by induction. □ 

Lemma 14.41 gives important limiting behaviour of the entries of N^'f for each p. Since it has been 
established by lemma that the entries are non negative and the rows sum to 1, lemma 1^1^ is a 
key step to showing that maxj sup^ A^"^^ is bounded, where A^*^^ is a fixed point for the approximating 
problem in theorem 14.51 

Lemma 4.4. If Xj +oo then {N^^)j — )• and consequently {N~'^)^j (in the limit, each entry 
of the jth column is identically equal to zero) for any integer r > 1. 

Proof of Lemma 14.41 Let f5kj = {N~^)kj- Then < f^kj < 1 by lemma |42] and /3 satisfies the 
following system of equations: 

/ 1 \ ( kj^j 

— afc,fc-i/3fc-i,j + + -J- J Pkj — Oik,k+iPk+i,j = 1 I ^ _ j 

where ak,k-iPk-i,j = when A; = 1 by definition and ak,k+iPk+i,j = when k = M hy definition. 

From the a priori bounds on (3k j from the previous lemma (0 < (3k,j < 1)) it follows that (3k j ^ — -> 
for all /c = 1,...,M. □ 

Having stated and proved the preparatory lemmas, the fixed point theorem may be stated and proved. 

Theorem 4.5 (Fixed Point Theorem). Let p = {pi, . . . ,pm) be a probability mass function satisfying 
T^i^ke{i....,M} Pk > ower a set of points S = {zi, . . . , with expectation Y^fLi'^'jPj — ^o{p) G ^■ 
Recall that h(p, X) is defined as in equation il8\) and let T be defined as in equation Assume that 
p is fixed. There exists a Xg {0} {0} satisfying 



This point satisfies 



and 



X = T{h{p,X)). (27) 



< min Xj < max A,- < +oo (28) 

ie{2,...,M-l} jg{2,...,M-l} 



min hJp,X)>0. (29) 
ie{i,...,M} - 
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Proof of theorem 14. 5L Part 1: Fixed point for an approximating problem Let h satisfy 
equation ([T8|). For < e < 1, let 

'^■^^'^^ V.) (30) 



M / 
j=l \2^k=l 



{hk{p,X)Ve) 



and let h^^^ be defined as 



? (^'^) = rnT^ . V e ) , (31) 



so that hj'\p,X) = 1. From equation ([2T]) lemma [¥?n it follows directly that 

^(/ifc(p,A) Ve) > 1, 

k 

since for each k, hf:{p,X) V e > hi^{p,X) and hj.{p,X) = 1. 

From this, it follows directly that C(A, e) > 1, which follows because e > ^ (/tfc(pA)V£) ^'^"^ hence 

"it VS^ii(/^;^(P,A)V6) J -fri\^k=iihkip,X)Ve) EkUhkip,X)y e) J 



1 



^(/ifc(p,A)Ve) = l. 



Efcli(^fc(P>A) Ve) ^ 
Furthermore, for each j € {1, . . . , M}, 

/ij(p, A) 



< 1 



so 



Ek=iihk{p,X)ye) 

that, for < e < 1, y2f-^ ( ^ V e ) < y^f-i (1 V e) = M. It therefore follows that 



l<f^(A,e) = 5: 



Since . ^ V e > e, it follows that 



(/ifc(p,A) Ve) 



Efe=i(ftfe(p-A)ve) 



inf min /i^'^ {p, A) > — . (32) 
X j •' — M 

Let 

^(^^(A,p)(j) := (^^'^ {p,X) ,j) jG{l,...,M} 
where J-" is defined in equation @. 

Recall the definition of C in equation ([3|). It follows directly that for any probability distribution p 
over {!,... ,M}, 
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and hence that 



(33) 



0<^(^)(A,p)(j)<- max ^^^±i-^^^#^^^^ =: C(^) < +00. 
e je{2,...,Af-i} [ij+i - - ij-i) 

for a constant C(^). Then, for fixed p, A^''\.,p) : {0} x R^^^^ ^ |q| ^ jg} x [0,C(^)]^^-2 x {0}. The 
space {0} X [0, C^*^)]*^^^ x {0} is a closed convex subset of M*^. The following consideration shows 
that, for fixed e > 0, the map A^'^\.,p) is continuous. From the definition of h (equation (fTSl) ). it 
follows that h{p, .) is a smooth function in A. It therefore follows directly that ll ^\p, .) is continuous 
in A and hence, using the lower bound (|32l) . it follows directly from equation ([4]) that for any fixed 
e > 0, A'^^\.,p) is continuous in A. It follows that the mapping A'^^\.,p) : {0} x [0, C^*")]*^"^ x {0} ^ 
{0} X [0, C^*^-*]*^"^ X {0} has a fixed point A*-*^^ by Schauder's fixed point theorem, which states that if 
-ftT is a convex subset of a topological vector space V and T is a continuous mapping of K into itself 
such that T{K) is contained in a compact subset of K, then T has a fixed point. 

Part 2: showing sup^maxj \f < +00. Let := li^'\p,>S'^). Then 

A(^) = T{h,) (34) 
so that, from the definition of C (equation ([3])), 

K,,xf =£{h^;j) j = l,...,M. (35) 
It follows from equation (|33p that 

K,<4- max - ^^V/^^ - "^'^^0. (36) 

" xf' ie{2,...,M-i [ij+i - - ij-i) 

The aim of this part is to show firstly that sup^ maxj A^*^^ < +00 and the next part that inf^ miuj h^j > 
0. From this, it follows directly that any limit point A of A^'^^ satisfies equation (|27p . 

Set 



P 



W = /i^Ar-C'-i)(A(^)), (37) 



so that = h{p^^\ X^^^). By construction, since each h^j > and h^j = 1, it follows using 
lemma where it is proved that {N^^^'^^^)ij > and ^j{N^^'''^^^)ij = 1, that for each j, 



< pf < 1. 



Furthermore, 
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Also, it follows from lemma [33] that if A^"^ +00, then (iV~(''-i)(A('))).j 0. 

Using the bounds on the components of together with this observation, it follows from equation 
daZ]) that if +00, then pf 0. 

From equation (j2ip lemma WA\ it follows that 

K{X,e):=^{hjip,X)\/e)>l. (39) 

j 

Prom the definition of h (equation ([TS]) ). it follows that h{p,X) is linear in p. Let 

C, = C{}S'\e) and K, = K{X^'\e). (40) 
Then, from the definition of h,, 



e 

. cv 

Note, from above, that 1 < < M and > 1. Let A'^^l^ denote A^''~"^(A^'^^) with column k replaced 
by a column where each entry is eK^ for each k such that h^ f^ = Since Y^jPj = 1, it follows that 

1 



pK-v (41) 



Let Se = = Now, by construction, note that 

(/V-'-'lA'-'jivJi)™.,™. = ( ^ (42) 

where I (mi, 1712) = 1 if rrii = m2 and I(mi, 7712) = if mi 7^ m2- This follows because ^mij = 1 
for each mi. Let 

F, = N-^'-^\x!-'^)nI\. (43) 
Directly from equation (gS]), it follows that ivjl\ = iV(''"i)(A('))F, so that, from equation (jiT]) . 



and hence, from equation ([37]), 



p(^) = -J^pN^''-^\X^''^)F,N-^'-^\X^'^). (44) 



Let Af be the matrix such that 



1 mi = m2, m2 5^ 
otherwise. 



That is, Ae is a diagonal matrix with entries K^-rn,m = 1 if m and A.^-^rn,'m = if m G S^, and let 
denote the matrix such that 
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1 7712 e 5e 
otherwise. 



That is, has columns of Is corresponding to elements of and the remaining columns are columns 
of Os. Then, from equation (|42p and the definition of in equation (j43p . it follows that 

= A, + eK,J,. 

From lemma 331 it follows that N^j^^ = 1 for each m, from which it follows that 

Ar('-i)(A(^))F,7V-(^-^)(A(^)) = iV('-i)(A(^))A,Ar~(^-i)(A(^)) + ei^,J-,iV-(^-i)(A(^)) 
and hence from equation (|44p that 

Since the elements of A^"^^'^'^) are non negative and bounded by 1 and > 1, it follows that 



lim-^pj;A^-(^-i)(A(^)) =0. 

e— >-0 Ce~ 

For any invertible matrix M, the eigenvalues of A4~^AA4 are the same as the eigenvalues of A. It 
follows that the eigenvalues of A^('-i)(A(^))A,A^-('-i)(A(^)) are the eigenvalues of A^ ; with multiplicity 
equal to the number of elements of and the remaining eigenvalues all 1. 



It now follows directly that if K^^ +oo, then p^*^^ 0, contradicting the fact that p^^^^ > for each 
j and J2jPf = 1 for all e G (0, 1). 



It follows that 

supine < +00. (46) 



It follows from the definition of (equation (p9l) and ()40p ) and the conclusion (I46p that 

M 

^hj{p,)S^'>) VO < supif, < +00. 
i=i 

Since hj{p,X) = 1 (lemma O equation ^) for all A G {0} x M^^^^ x {0}, it follows directly that 
sup^maxj \hj{p, }S^^)\ < +oo. 

Let A*(') = maXj A^"-' and let A^*(') = -^Ni^S^^) (that is, divide every element by A*(^)). Let 
gj = j^(;j!i—Tjhj{p,)iS'^^). Then if there is a sequence e„ — ?> such that A*^'^") n^^-oo _|_^^ follows that 
g "l^l^ and hence that, for any limit point N* of N*^''"\ 



= pN 



*(r— 1) 
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But it follows from the construction of A^* that the rank p of N* is the number of components of A 
such that lim„^-(_oo > 0) where A*^"^"^ is a sequence that gives the limit point. This is seen as 

follows: consider the lowest index ki such that lim„,_j>+oo > 0, then in A^*, the limit, column 

ki — 1 will have exactly one entry; element N^^ will be the only non-zero element of column ki. 
Suppose ki < . . . < kp are the relevant indices, then the columns (-/V*^^_-|^, . . . , A^*^^_-^) provide an 
upper triangular matrix, with elements A'^^. ^ and Np^kj~i = for all p > kj + 1, proving that 
N* is of rank p. 

It follows that A^*(''~i) is of rank p and the non-zero rows of A^*(^'~i) are those corresponding to 

the indices k : lim„_j.+oo jitj^ > 0- Since the space spanned by the p rows is of rank p, it follows that 
Pk = for each of these p^, which is a contradiction (since, by hypothesis, pk > for each k). 

Hence 

supA*(") < +C30. (47) 

e 

Part 3: showing infemirij Xf > 0. Now suppose that A^'-' for some j G {2, . . . , M - 1}. Let 
= a.d a, = ^ so that 



ih''>. 



It follows from equation (I47p that sup^ Ce < 1, where the inequality is strict. It follows from lemma 14^21 
equation (p3|) . because q^j — > while sup^ < 1 (the inequality is strict), that Nj^^^ ^^(A^^'') ~^ for 
all {k,p) such that k<j<poik>j>p. This follows from the following consideration: let T{ae) 
denote a random time with probability function 




F{T{a,) = k) = {1 - aj-' \^ • ^ ja^ A: = 0,1, 2, 
independent of the DMRW (definition 12. ip with parameters q^. Note that 

supE[r(a,)] = — < +oo, 

e 1 CL 

where a* = sup^ a^. If q^j for some mi < j < m2 where mi < m2, then 



nxl'l^^ = i^jxj^^ =im,) = = im^lX^'^ = imi,T(a,) = fc)P(r(a,) = k) 

k=0 

oo k 

= Y.Y1 ^(4? = h\4'^ = im^Mxtlk, = in.,\x!,'^ = ^JMr{ae) = k). 

k=0 ki=0 

If q,„j 0, then F(xJ'"^ = i^al^^"'' = ij) ^ for ah k. It fohows from lemma lU equation (f23D 
that 

n4Tal) = ^^2!^^"^ = im,) = (iV-(^'-^))™„„.,(A(^")) ^ 

for all (mi, 7712) such mi < j < m2. The proof that the result holds for mi > j > m2 is similar. 
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Furthermore, it follows from equation (l35l) (£ is defined in equation ([3])) that for any sequence with 
hmit point A^^^ such that A^'"^ for some j, if j < / - 1 then hk{p,>S°^) < for all 1 < A; < j - 1 
and if j > / then A^^^) < for all j + 1 < k < M. 

It follows, using 

P = Up,X)N-^''-'\>^), (48) 

and taking A = A*-"^ and considering the zeroes of A^^(''^-'^'(A^''^) that if j < / — I, thenpi < 0, . . . ,Pj-i < 
0, which is a contradiction. If j > I, then Pj+i < 0, . . . ,pM < 0, which is a contradiction. 

It follows that any limit point A satisfies the bounds of ([28|) and consequently that 

/io,i > 0, . . . /io,j\/ > 0, 

consequently that h{p, A) = and hence that (j29p is satisfied and that A satisfies equation (j27p . The 
theorem is proved. □ 

Corollary 4.6. Let A € {0} x M^"^ x {0} be a solution to equation \27\) where min^pj > 0. Let 

A* = maXjg|2,...,A/-i} ^j- Then A* < +00 and for all a G [gq, 1), where = j^^-r, q{a) = — l) A 
satisfies 

,W = (i - 1) ^(i (p. (^) ,(„))). (49) 

Proof This follows directly from the preceding theorem. □ 

Proof of theorem 12.61 Let P denote the probability measure with respect to both the random walk 
X and the independent random time r. There is a solution to the problem if and only if there is a 
q € {0} X [0, X {0} such that the matrix P{q) constructed according to definition 12. H which is 
the one step transition matrix for a discrete time Markov chain X, satisfies 



Pj =F{Xr = ij\Xo = eo) (50) 

= (1 - ay Er=o ' ^ ) {^Ai^Pig)n-i, + 'i^i{aP{g)n,) k-i <e,< ii. 

Define G{q) by 

G{g) = f:{"\^_\^\aP{q))\ (51) 



fc=0 

then G{q) satisfies 



G{q){L - aP{q)Y = (/ - aPiq)YG{q) = L. (52) 
Using equation (|5ip . q G {0} x (0, 1]^^^^ x {0} is a solution to equation (j50p if and only if 
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= (1 - af .° + -^-^G,_i,,(g) J = 1, . . . , M < eo < (53) 

ii-i - 2; - - y 

Recall the function h defined in equation (fT8|) satisfies equation (j20p . It follows that 



fc=l ^ ^ ^ ^ fc=l 

1 

^ fc=l 

Prom equation (j53|) . using /i^ to denote /i^ ^p, (^i^) follows that g G {0} x (0, ^ |q| jg 

solution if and only if (using the expression in equation (|50p for p) 

M ^ M 

k=l ^' k=l 

M . M 

= (1 - «)ff|ff E G,k{g)G-,]iq) + ^ E g-m(^)gS(.) 

k=l k=l 



-{I -a) j = l-l 

1 - a) j = l (54) 



eo-»i-i I 

i G {1,...,M}\{/-1,/} 



if ii-i < cq <ii. From this, it follows that for any solution q € {0} x (0, 1] x {0} 



(oo . oo \ 

n - H-i Po - 'I- j^o ~ I 

for k = 1, . . . , M and therefore, for a G (0, 1), for any solution q G {0} x (0, 1]^^^^ x {0}, hj is positive 
for each j. From lemma W?\\ it follows that /i is a probability function on S = {ii, . . . ^im} such that 
Y.f=i^jhj = eoip). 

It follows from lemma \37l\ that q satisfying equation (l54l) satisfies 



It follows from corollary 14.61 that there exists an ao < 1 such that for all a G [aoi 1) there is a 
q G {0} X (0, 1]*^^^ X {0} satisfying equation (|55p . The proof of theorem 12.61 is complete. □ 

5 Proofs of theorems 12.71 and 12.81 

This section presents the proofs of theorems 12 . 71 and 12 .81 Theorem 12 . 71 states that for any prescribed law 
p over S = {zi, . . . , i^f } and T F (r, ^) a random time with a gamma distribution, there is a CMRW 
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(definition \2.2\i X, such that for T independent of X, ¥(Xt = ijIXq = eo{p)) = pj for j = 1, . . . ,M. 
Theorem 12.81 takes the hmit as r — )• +00, with E[T] = t fixed. It foUows that T — )• t in law, from 
which it follows that for any t > 0, there is a CMRW X such that T'(Xt = ij\XQ = eo{p)) = pj for 
j = 1, . . . ,M, the subject of theorem 12.81 

Theorem 12.71 is proved using theorem 12.61 Let r ^ NB{r,a) and T^^^ = t5. For fixed r, the 
parameters a and 5 are chosen such that E[r('^)] = t. As 5 ^ and 1, T^^^ F (r, 

Subsection 15.11 deals with the proof of theorem 12.7) while subsection 15.21 deals with the proof of 
theorem 12.81 

5.1 Proof of theorem 12.71 

By theorem 12. 6| there exists an such that for all a G [ao, 1), if t ~ NB{r, a) (negative binomial with 
parameters r and a), then there exists a DMRW X (depending on the parameter a), independent of 
r, such that 

F {X^ = ij\Xo = eo{p)) =Pj. 

The one step transition probability matrix of X is P{q) (following definition 12. ip . where q = (^ — l) A, 
where A is a fixed point of equation (j27p . For fixed r > 1, let T^^^ = t6 and choose 6 such that 
E[r(^)] = t. Then, since E[T('')] = = t, it follows that a = j:^^ giving q = ^A. 
Choose 6 sufficiently small such that a > ag; that is 

Lemma 5.1. Let LiJ^^^) denote the law of T^^\ Then, as5 ^Q, 

That is, let T denote a random variable with the limiting distribution, then T has a Gamma dis- 
tribution. This may be expressed as: T = Xi + . . . where Xj ~ Exp{j) and Xi, . . . ,Xr are 
independent. 

Proof of lemma 15.11 Firstly, 




.(T(« =„*)=( — . ^^-^ „ = 0,1.2,... 



and, for T ~ F (r, ^), 



'in5 <T<{n + 1)5) = _ (-) / x^-^e-'^^/'dx 

(r 1). \tJ Jfj^g 

I i'r{n+l)S/t 



It follows that 



(r- 1)! 



rnS/t 
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rS 



mill y''~^e~y < F{nd < T < (n + 1)6) < 



rS 



t{r - 1)! y^\ rnS _ r(n + l)S 



t{r - 1)! ^^j' rng ^ r(»+l)a 

from which it follows that for any s > 0, with n = [s/S], using Stirling's formula, 



r — 1 — V 

max y e " 



lim 

5^0 



r{T(^) = n5) 



<T <{n + l)6) 



lim 

5^0 



(ra+r-1)! /rSy /i , rS\-{n+r) 



- 1 



= lim 



lim 

<5-)-0 



(n+r) 



-rs/t 



Prom this, it follows that 



and the result follows. 



lim sup 



p(t('^) < s) -P(r < s)| = 



□ 



Let y}^^ = X^g/gj . Convergence in distribution in the sense of finite dimensional marginals is outlined. 
That is, for any < si < . . . < s„ < t and any {ik^, . . . , z^^) C S", convergence of 

n 



is outlined. Note that 

For any < si < S2 < +oo. 



Sj — l 



Y 



P(nS. = ^.- V 0<r<.2 I = = (1 - = (l - y A,) 

where /(S2) is either [52/'^] or [s2/(^] + 1- It follows that 



.f(s2) 



( 



(<5) 



si+r — "J 



ij V < r < S2 



) = exp 



(56) 



Let T^^\ij) denote a random variable with cumulative distribution function 



P(r(^)fe)<.) 



and let 



\ l-exp{-fAj} (5 = 

'^d ^ (bb ) ' ''"1 (b'l ) ' '^2 (b'2 )■:■■■ 



(57) 
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denote independent random variables such that Tn\ij) == T^^\ij) for aU n > 1 and all ij € 5. Then 



= h =ik\= nri'\ik) >s;j = k) 



(58) 



n=l ai,...,a„_i 



n-1 



n-1 



m=l 



n=l 



xP(ai, . . . ,a„_i,ij) 



where the notation ¥{ai, . . . ,an-i,ij) denotes the probability that at the first n jump times, the 
sequence of sites the process visited was ai, . . . , an-i,ij- It follows from equation ([57|) (details omitted) 
that 



lim sup max 

-5^0 s>0 (i,fc)e{l,...,M}2 



4'\^k) + Yl ^^^M < s < + ^ri^)(a„) + rW( 



n-l 



n-l 



m=l 



n=l 



n-l 



n-l 



-P j^rf (i,) + r^H<^m) < s < + ^rW(a„) + rf(i 

for each n > 1 and that 



m=l 



n=l 



lim sup max 

5^0 s>o {j,k)e{i,...,M} 



r!>'\ik) >s;j = k)- P(r7(4) > s;j = k) 



(0), 



0. 



From this, it follows (details omitted) that the processes Y^^'^ converge, in the sense of convergence of 
finite dimensional marginals, to a process Y . In particular, Y satisfies 



lim sup max 

<5-^0 s>Q (i,fc)e{l,...,A/}2 



(<5) 



Y^^'^ =ik ) -^{Y, = ij\Yo = ik: 



Note that, for all 5 G (0, (5o 



p(y(a=z,|yJ^) = eo)=p,. 



0. 



(59) 



It is required to show that this also holds in the limit; namely, P(1t = = cq) = Pj- Firstly, 



\ny^% = ij\Y^°> = eo) - HYt = i,|>o = eo)| < |P(l^^(i) = i^K' = eo) - P(1't(*) = h\Yo = eo)| 



(5) 



.(5) 



+ |P(yr(^) = i,-|yo = eo) - P(1t = b-|>o = eo)| = / + //. 



For /, 



< 



'n5 



< 



.{5) 
'n5 



n=0 
/■oo 



eo)-¥{YT(s) =ij\Yo = eo)\ 



n=0 

oo 

gn{x)fT{x)dx 



eo) - P(yn5 = i,\Y^ = eo) P(r('^) = n5) 



eo)-FiYn5 = ij\Yo = eo) 



»(r(^) = n6) 



¥{n6 <T < (n + 1)(5) 



<T < (n + 1)(5) 
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where fx is the density function of T and 
gnix) = P(yi? = ij\Yo^^^ = eo) - nYnS = ij\Yo = eo) 



F{n6 <T <{n + 1)6) 



n5 < X < {n + 1)6. 



5^0 



It now fohows directly from equation (|59j) and dominated convergence that / — > 0. 



For II, let fx denote the probability density function of T, then 



\F{Yt^s) = ij\Yo = eo) - P(1t = ijlYo = eo) 



For II{i), 



P(y„5 = i,\Yo^'> = eo)P(T(^) =n6)- / F{Yt = ij\Yo = eo)fT{t)dt 

JnS 



n=0 

oo 

< ^P(y„5 = ij\Y^^^ = eo) (P(r(^) = n6) - F{n6 < T < {n + 1)6)) 



n=0 



+ I \nYnS = ij\Yo = eo) - FiYt = ij\Yo = eo)| fT{t)dt 



n=0 



nS 



II{i)+II{n). 



(60) 



For II{ii) 



^F{Yn5 = ij\Y^^^ = eo) (P(r(^) = n6) - ¥{n6 <T <{n + 1)6)) 



n=0 



<Y^r{n6<T< {n + l)6) 



n=0 



»(tW = n6) 



F{n6 <T <{n + 1)6) 



5^0 



max max |P(y„5 = i^- jYo = eo) - F{Yt = ij \Yo = eo) | ^ 

n te[n5,{n+l)5] 



5^0 



from which it follows that II{ii) — > 0. 



The proof of theorem 12.71 is complete. 



□ 



5.2 Proof of theorem 12.81 

By theorem 12.71 for any integer r > 1, any given t > and any given fixed probability measure 
p over a finite state space S = there exists a CMRW (definition E^l) such that 

f(^xP =ij\X^Q'' =eo(p)) = Pj, where T is independent of X^*") and satisfies T ~ T{r,l). Let 
/i^'"'* satisfy l^^\p,X) = pN'^~^{}^- This is equation (jlSp . where the parameter r is explicitly stated, 
because the task here is to let r — >• +oo. Let A^''^ denote the fixed point, satisfying equation ([27]) from 
theorem 14.51 From the proof of theorem 12. 7| the Markov chain X^*"^ remains on a ij for an exponential 
holding time T^'^'\ij) which satisfies P (T^^\ij) > s) = exp I^T-^i^^}' This is the content of equation 
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57|) . Now set p"p = j\^p and let p^^^* = maXjg{2,...,M-i} Pj*^^- Suppose that sup^p*^*"^* = +00. It 
follows that there is a j E {2, ... ,M — 1} and a sequence (r„)„>i such that p^'""'' ^ +00. Then, for 
ij > eo and /c € {j + 1, . . . , M}, or < eo and k G {1, . . . , j — 1}, 



Pj+1 < 1 - P(r("")(ij) > T) = 1 - / P(r('^")(ij) > x)fT{x)dx 

JO 

where denotes the density function of a F (r, ^) random variable. This contradicts the fact that 
minjgjx^ > 0. Therefore, sup^ pC*")* < +00 and therefore there exists a limit point p of {p^^^)r>o- 

Let Tr r^T (r, i). Then = t and V(rr) = ^ 0, so that for any e > 0, it follows from 

Chebychev's inequality that 

p(|r, -t| > e) "^~0. 

Let n>i denote a subsequence such that lim„^.+oo maxjgji^ \pj — Pj" \ =0. Let X 

denote the CMRW process on S = {ii, . . . ,iM} with holding intensities p. Then for each j and each 
r, ¥{x!f^ = ^j) = Pj- Furthermore, 



and 



so that 



lim max \F(X^"^ = iA - Pfxf''"^ = i,- 

n^+oojG{l,...,Af} ' ■' 



lim max |P(xf = iA - F{Xt = = 



nXt = ij)=Pj j = l,...,M. 
The theorem is proved. □ 

6 Krein's Strings and Markov processes 

The discussion so far has been about finite state spaces and constructing Markov processes, both 
discrete and continuous time, that have a given marginal at an independent random time with a 
certain specified distribution (geometric, negative binomial, gamma), then taking a limit to obtain a 
specified deterministic time, with the requirement that the process is a martingale, which jumps only 
to nearest neighbours. 

The remainder of the discussion is the extension to prove existence of a Markov martingale of 
diffusion type with specified distribution at a specified time f > 0, for an arbitrary specified distribution 
p, such that \x\p{dx) < +00, over M. This is the content of theorem 12.91 

The process in question, in the generality required, is discussed by Kotani and Watanabe in |10| . 
where it is called a 'generalised diffusion' and by Knight in [11], where it is called a 'gap diffusion'. 
The term 'skip free diffusion' is also used in the literature, emphasising that the movement is between 
nearest neighbours. 

Section [6] gives the background on Krein's strings, their relation to Markov processes and the 
results on spectral theory that are needed for some technical lemmas. Section [7] then considers a 
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limiting sequence of atomised measures and shows that a subsequence of the corresponding processes 
converge to a well defined gap diffusion with the prescribed terminal distribution. 

6.1 Krein's strings 

Krein defined a string on an interval [0, 1], for / < +00, where I is the length of the string and, for any 
Borel set A S B{[0, 1]), m{A) corresponds to the mass of the string on set A. The string is 'tied down' 
at the point 0. Krein was interested in the dynamics of the string. He introduced the second order 
operator -^^^ (defined formally later) with this in view. He developed the theory of such operators 
in |12) : their spectral properties were studied in [9]. They are discussed at length in the book |5]. The 
reader is referred to these works for proofs of results about strings that are stated here without proof. 

This operator may be seen as the infinitesimal generator of a Markov process, which Krein did not 
have in view. To give a full description of the Markov process, Krein's operator was altered to accom- 
modate Dirichlet boundary conditions at the left end point, as found in Kotani and Watanabe [10]. 

Notation Throughout, the following notations will be used: 

1. For an interval, a square bracket denotes that the end point is included; a curved bracket denotes 
that it is not included. For x < y, {x, y) includes neither x nor y, [x, y] includes both x and y, 
[x,y) includes x but not y and {x,y] includes y but not x. 

2. For X G M, [x] denotes the integer part of x. That is, 

[x] = maxjz € Z,\z < x}. 

3. f'-{x) denotes the left derivative; limfe_j.o ■^^^^ j^^^ and /+(x) denotes the right derivative 
/;(x) = lim,^o 

4. signifies integration over the half closed interval a < x < b. Similarly, indicates that the 
mass X = a is included while f'' includes the mass of a but excludes the mass of b. 

Definition 6.1 (Krein String). A string measure m* is defined as a measure over B(Fi), that satisfies 
the following properties: there is a non- decreasing cddldg (right continuous, left limits) function, A4, 
defined on (—00, +00) such that 7W(0) = and for x > —00, A4{x) > —00 and for x < +00, 
M{x) < +00. Let Iq = sup{x|A^(x) = mizM{z)} and li = 'mf{x\M{x) = sup^ M{z)}. If h < +00, 
there is a point Li S [/i,+oo) and if Iq > —00 there is a point Lq € (— oo,/o] (Li = +00 if li = +00 
and Lq = —00 if Iq = —00) such that 

' m*{{a,b]) = M{b) - M{a) Lq < a < b < Li 

< m*({Li}) = +oo and m*((Li, +00)) = if Li < +00 (61) 
m*({Lo}) = +00 and m*((— 00, Lq)) = if Lq > —00 

m* is used for construction of the Markov process according to Kotani and Watanabe |10| with 
cemetaries Lq and Li. 
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The gap diffusion process of definition 12.31 has infinitesimal generator Q* = As S. Kotani 

points out and proves in appendix 1 of |10| . pp 250 - 254, the operator Q* defines a self adoint, positive 
semidefinite operator on the Hilbert space L^([Lo, -Li], m*); the difference between the string of Kac 
and Krein and m* discussed by Kotani is the difference between Neuman boundary conditions at Iq 
and Dirichlet boundary conditions at Lq. 

Notation For A G B{R), 

2 / f2 



L^{A,m*) ^ jj {x)m*{dx) and {f , g) L^{A,m*) = j J{x)g{x)m*{dx) 
with the convention that if h{x) = and m*({x}) = +oo, then h{x)m*{{x}) = 0. 

6.2 The differential operator 

The differential operator Q* associated with a string m* is defined by 

dm* 

where and f'_ denote right derivatives and left derivatives respectively. The formal definition is 
taken 'under the integral' and is given in equation (162^ . 



When Li — Lq < +oo, the operator Q* = restricted to ^{Q*), the domain of the operator 

(defined below), is a self adjoint, negative definite, densely defined operator on the Hilbert space 
L^([Lo, -Li], m*). The relevant results from |12| . [9] and [5] with modifications to the Dirichlet boundary 
conditions at Lq given by Kotani in appendix 1 to [lOJ, are summarised below. 

Definition 6.2 (Operator domains: Li — Lq < +oo, m{{LQ, Li)) < +oo). Let m* he a string defined 
from a function Ad using equation (EZP; with Li — Lq < +oo and m*((Lo, Li)) < +oo, Lq and Li are 
as in definition \6.1[ The domain T>q(Q*) is defined as the space of functions f defined on the whole 
real line M that satisfy the following property: there is a function g such that 

/(x) = /(Lo) + /i(Lo)(x-Lo) x<Lo 
fix) = /(Lo) + /i(Lo)(x - Lq) + fl^ Jl^_ g{z)m*{dz)dy x > Lq (62) 
J^^^_gHz)m*{dz) <+oo 

Such a function g is written g = Q* f . 
The domain T>^{Q*) is defined as 

v^{g*) = VQ{g*)n{f\f{x) = o Vx<Lo}. (63) 

The domain I'+(^*) is defined as 

v+{g*) = Vq{g*) n {/lll/ilL2([i„,i^],^.) + ||r/llL2([Lo,L,],m*) < +^} n {/(x) = o Vx > l,]. (64) 

The domain T>{Q*) is defined as 

v{g*) = v^{g*)r\v+{g*). (65) 
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This implies that for Li — Lq < +00, m* {{Lq,Li)) < +00 and m*({Lo}) = m*({Li}) = +00, any 
/ G V{g*) satisfies f{x) = Vx E (-00, Lq] U [Li, +00) and e*/(^o) = = 0; if G*f{Li) / 0, 

then m*{{Li}){g* f{Li)f = +00 and hence \\Q* f\\L^[LoM],m-) = +00, similarly for g*f{Lo). 

Definition 6.3 (Operator domains: Li — Lq = +00). Let m* be a string defined from a function A4 
using equation \61\) where Li — Lq = +00. The domain T>q{Q*) is defined as the space of functions f 
defined on the whole real line M that satisfy the following property: if Lq > —00, there is a function g 
that satisfies equation ^6^1 . If Lq = —00, then there is a function g such that 



' fix) = fia) + (x - a)fUa) + T II 9{z)m*{dz)dy 

< y-oo<a<x< +00 (66) 

g'^{z)m*(dz) < +(X) V — 00 < x < y < +cx3. 

Such a function g is written g = Q* f . If Lq > —00, then T>^[Q*) is defined by equation i63\) . If 
Lq = —00, then T>^{Q*) is defined as 

V^ig*)=VQig*)n{f\ lim f'_{a)=0, lim f{a)=0}. 

a— >+oo a— >+oo 

If Li — Lq = +00, then 

' v+{g*) = VQ{g*) n {f\\\f\\m[.,M,^') + W fUm^.M,^-) < +00} 

n{/| limfc^+oo f{b) = 0, limfe^+00 f'+{b) = 0} (67) 

V — 00 < Zi < ^2 < +00, Zi > Lq, Z2 < Li. 

The domain V{g*) is defined as V{g*) = V_{g*) nV+{g*). 

The following theorem, stated without proof, describes the spectral theory that will be used. 

Theorem 6.4. Letm* be a string defined by equation \61]) such that Li—Lq < +00 andm*({LQ, Li)) < 
+00. The set T>{g*) is a dense subset of L'^{[Lq, Li],m*). Every f E T){g*) has left limits and right 
derivatives, satisfies /i(Lo) = /^(Li) = 0, f{x) = for x G (— oo,Lo] U [Li,+oo) and the operator 
g* : T>{g*) — 7> L"^ {[Lq, Li[,m*) defined by g* f = is well defined, self adjoint and non negative 

definite. Let {r]k, —^k)k>o denote the sequence of eigenf unctions / eigenvalues. Then inf^ > 0. 

Proof The result, including the strictly positive lower bound on the spectrum under the hypotheses 
that Li — Lq < +00 and m*{{LQ,Li)) < +00, is found in appendix 1, by S. Kotani, to |10] . □ 

6.3 The string associated with a CMRW (definition [M]) 

This subsection shows how the holding intensities for the sites are related to the string measure for the 
continuous time martingale Markov random walk on a finite state space. Let S = {ii, . . . ,iAf} C M, 
ii < . . . < iM . Assume there are two constants < c < C < +00 where the inequalities are strict such 
that c < m.mj^^2,...,M-i} ^ ™3'Xje{2,...,A/-i} < C and that nimj^^2,....M}'''j ~ ^j-i > 0- Let 



M{x) 



x <i2 

Yl'j=2^j ik<x<ik+i k = 2,...,M 
M{x) =M{x)-M{Q). 



(68) 
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In the notation of the definition, Iq = 12 and li = im-i- Let Li = im > iM-i and Lq = ^1 < *2- Let 
m* denote the string defined from Ad by equation (j6ip . Then = ej for j = 2, . . . ,M — 1, 

m*({ii}) = ?TT-*({zjv/}) = +00. The generator Q* satisfies 



g*f(i) = _i ( /fe+i)-/fe) _ /fe)-/fe-i) \ j e {2,...,M-1} 



[ g*f{ii) = G*f{iM) = 
This can be expressed as 



(69) 



The operator Q* is the generator of a CMRW (definition 12.2^ with holding intensities 

1 A(ii) = A(u/) = 



A(ij) := nfi+^r^'^^^ ^ j = 2,...,M-l 



(71) 



For j G |2, . . . , M — 1|, when it jumps from i,,-, it jumps to with probabihty Z^"*"^ and to 



with probabihty ^ — -■ — . Note that 

^i-i + = i = 2, . . . , M - 1. 

If the process arrives at iu-, it remains there for ah subsequent time; if it arrives at it remains there 
for all subsequent time. The process is therefore a martingale. 

6.4 The transition semigroup and differential equations 

Let X denote the gap diffusion, definition 12.31 with state space (—00, +00) n [Lo,-Li], associated with 
the string measure m* . Let V denote the transition probability function; that is, V(^s\x^A) = ¥{Xs € 
A\Xq = x). Let Q* denote the second order differential operator corresponding to m*. 

Consider Li - Lq < +00, m*{{Lo,Li)) < +00. For A G S((Lo,Li)), V{s;.,A) G L'^{[Lo, Li],m*), 
since V{s;Lo,A) = 'P{s;Li,A) = 0. Let Ck{s,A) = {Vis; ., A),r]k)L2{[io,Li],m*) and let Ck{A) = 
Ck{0,A) = fj^m{y)m*{dy). 

Since Q* is the infinitesimal generator of X, it follows that -^V{s; x, A) = Q*V{s; x, A), from which 

j -§^Ck{s,A) = -XkCk{s,A) ^^^^ 



Ck{0,A) = f 'qk{x)m{dx) 



and hence 



V{s-x,A) = ^Cfc(^)e-^'=V(a;). 

k=l 

Lemma 6.5. For any A C {Lq,Li), for all s > 0, V{s; .,A) G V{g*). 
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Proof For Li — Lq < +00, from the definition, the only point that has to be proved is that 
jl^^^_^g*'P(^s;x,A)fm*{dx) < +00. This fohows, because g*V{s;x,A) = - EfcLi Cfc(^)Afce--^'=*r/fc(2;). 
Since X'^e~'^^^ < (the bound independent of A, obtained by differentiation), it follows that 

Li 1 fLi 



{g*Vis;x,A)fm*{dx) < \e~^ [ ' {V{s;x,A)fm*{dx) < \e-'^m* {{Lq, Li)) 
and the result follows directly from the definitions for Li — Lq < +00. 



For Li — Lq = 00, the important feature is the upper bound A^e^^'^* < ^e~^. A limiting sequence 
may be employed; for —00 < zi < Z2 < +00, Lq < zi < Z2 < Li and A G B{{Lq,Li)), let X denote 
the process generated by Q* , let r^^ = inf{s|Xs < zi}, = inf{s|Xs > Z2} and let X^^'^^ be the 
process defined by 



Xs < S < T^, A 

Zl S> A Tz^ < (73) 

Z2 S> Tz-, A Tz2 Tz-, > Tz2- 

Then X^^'^'^ is the process associated with the string measure 



^' I +00 Zl £ A or Z2 & A. 



Set 



Vz^,Z2{s; X,A) = ^ [{Xs e Af} (Zl, Z2)} r\{zi< inf Xr < sup Xr < Z2> \Xq = x ] . 

V I 0<r<s 0<r<s J / 

Let Vzi.z2 denote the transition probability for the process associated with the string measure m*^ 
and note that Vz^.z2{^]x^ = 'Pzi,z2{^:^t (-2^1) -22))- The quantity Vzt,,z2{s^^i is non decreasing 
as Zl 4 Lq and zi t Li and 

V{s;x,A)=\{vii\iraVz,.z2{s;x;A) VxG(Lo,Li), ^A(^B{{Lq,Li)). 

ziiLa 22 til 

The result follows from the definition of T>{Q*) together with the upper bound on A^e^^^'^ which is 
independent of the eigenvalue for s > 0. □ 

For X < Lq, 1^(3, X, A) = 1 if Lq £ ^ ^ind otherwise. For x > Li, 7^(3, x, A) = 1 if Li G yl and 
otherwise; the process X is a martingale if the initial condition x satisfies x G [Lq, Li]. 

The following lemma helps to describe the structure of the transition probability; equation (1751) shows 
that the transition probability may be decomposed as a symmetric function, within the domain of the 
operator in both space variables for all t > 0, integrated against the measure. This decomposition is 
well established (see, for example, Borodin and Salminen [1] for the absolutely continuous setting). 

Lemma 6.6. There exists a function q such that q{s;x,y) = q{3;y,x) for all {x,y), s >0, satisfying 
q{s; ., .) G T>{Q*) x P(t/*) for each s > 0, such that, for A G B{{Lq,Li)), the transition probability may 
be written 
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V{t;x,A)= f q{t-x,y)m*{dy) A B{{Lq,Li)) x G R. (75) 
J A 

For Li—Lq < +00 and m* {{Lq, Li)) < +00, let {—Xk,'r]k)k>o denote the eigenvalues and eigenf unctions 
corresponding to the complete orthonormal base of the operator Q* associated with m* . The function 
q{t; X, y) may be written 

q{t- x,y) = Y^ e-^''%{x)m{y)- (76) 
k 

Proof First consider Li—Lq < +00. From equation (j72p . it follows that Vit; x, A) = Cfc(t, A)r]k{x) 
where 

Ck{t,A) = e-^"' [ r]kix)ni*{dx). 
J A 

It follows that V satisfies equation (j75p with q defined by equation d76|) . For Li—Lq = +00, consider the 
restricted processes of equation (f73|) associated with the restricted strings of equation (j74p . with Vz^,z2 
the transition probability for the restricted process. Since Vzi,z2{Si x, A D {zi,Z2)) is non decreasing 
as zi 4 —00 and Z2 t +00 for all A £ B{{Lq, Li)), it follows that the functions qz^^z2i'tj ^jV) from 
equation (|76p for the restricted string are non decreasing as zi J, —00 and zi t +00 and the function 
q{t; ., .) = lim^jj^.oo lim^^^+oo 921,22 •! •) satisfies the criteria. □ 



7 Proof of theorem 12.91 

This section is devoted to the proof of theorem 12.91 that for any probability measure fj, over R such 
that \x\iJ,{dx) < +00, and any fixed t > 0, there exists a gap diffusion (definition I2.3p X such that 
for all xeR, F{Xt < x\Xo = eo{ii)) = //((-oo,x]). 

The result of theorem l2.8l is used as the starting point for the proof. The measure /i is approximated 
by a sequence /U^"^ where for each n, as a function of x, /i^")((— 00, x]) is a step function. For each 
theorem 12. 81 gives a process, for which there is an associated string measure m*^"'\ The characterisation 
of the Markov process associated with a string m* is given in definition [231 This turns out to be a useful 
characterisation for showing that convergence of strings implies convergence of associated processes. 
That is the subject of lemma [TTTl After this is established, the remainder of the proof of theorem 12.91 
involves showing that convergence of to a measure // implies existence of a convergent subsequence 
of strings. 

Lemma 7.1. Let (?7i*("))„>i denote a sequence of strings, defined according to definition \6.1\ equation 
i61\) . with Lo^n o-nd as left and right cemetaries respectively for the string m*^'^\ Lo,n i Lq > —00 
and Li^n t -^^i < +00. Assume that there is a string measure m* , with left and right cemetaries Lq and 
Li such that 

lim sup|m*(")((Lo,„,zALi,„)) -m*((Lo,zALi))| =0. (77) 

n— >+oo z 
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Let X^"-* denote the Markov process associated with m'^"'-** according to definition \2.3\ and X the Markov 
process associated with m* . Then for each z E [L^^Lx), any sequence (zn)n>i such that Zn ^ z and 
Zn € (Lo,n, -^^i,n) for cach n and any t < +00, 



lim sup P ( 



) < wlX^""^ = Z, 



) -F{Xt<w\Xo = z) 



0. 



Proof Let W denote a standard Wiener process started from and let a) denote its local time 
at site a G M, at time s > 0. Let 

T(")(z,s)= / (j){s,a- z)m*^"'\da), T{z,s) = [ (j){s , a - z)m* (da) . 



Note that, for each a, (j){r, a) is nondecreasing in r, continuous in both r and a and limr_i.+oo o) 
+00 for each a € M. Define 



T(")~^(z,s) =inf {r| [ 0(r, o - z)m*(")(da) > s 1 , r-^(z, s) = inf {r| [ 
[ Jr J [ Jr 



(r, a — z)m*[da) > s 



Then, from definition [231 X^'^'' has representation X^'^\t,z) = z + W {T^'^^-^{z,t)), while X{t,z) has 
representation X(t^ z) = z+W{T^'^{t, z)). The result now follows from this characterisation of X*^") and 
X, together with continuity of W and the continuity of its local time giving lim„_j.+oo ^''•"^""^(•Zni — ^ 
T~^{z,t) almost surely, from which convergence of the laws follows. □ 



Proof of theorem 12.91 Let ^ denote the target measure. Define the points 
Xn,i = inf{z|^((-oo,z]) > ^} 

XnJ+l = inf {z > Xn,j\lJ-{{-00,z]) - n{{-00, Xnj]) > ^} 

until either /i((-oo, a;„j+i]) = 1 or 1 - /i((-oo, x„j+i]) < ^ 
Mn = ma.x{k : fi{{-oo, Xn,k]) < !}• 

Let p^"^ = {p^^ ) • • • ; P^M„ ) denote the probability mass function defined by 

Pi"^ = ^((-oo,2;„,i]) 

Pj"^ = K(.^n,j-l,Xn,j]) j = 2, . . . , Mn - I 

. = 1 -^((-oo.3;„,M„_i]), 



over {xn,i, • • • , Xn,Mn} with expectation 



Mn 



e,{^''^) = Y.Xn,p) 



(n) 



Then, by theorem I2.8| for each n there exists a CMRW f definition I2.2p X^"^ with a finite state space 

Sn = {Xn,l . . .,Xn,MJ S^ch that PC^^"^ = X„,,-|x(") = eo(p("^)) = pf- 

Note that, for j = 1, . . . , M^_i, 



in) 



=M(-oo,x„,,]) i = l,...,M„. 



Furthermore, it follows that 
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/oo 
x/i((ix). 

Note that, by construction, for any n < +00, —00 < Xn,i < Xn,M„ < +00, Xn,i is non-inreasing in n 
and Xn,M„ is non-decreasing in n. Let Qq = lim„^+oo 2^ri,i and Q\ — lini.fi_^^oo Xn,Mn'- Qo possibly —00 
and Qi possibly +00. 

Let 

S = {x|/i({x}) > 0}. (78) 

<S is the set of atoms of fi. Let m*^") denote the string corresponding to the process Then 
there is a non decreasing function M.^'^\ with M^'^\0) = 0, M^'^\xn,2) > —00, M^'^\xn,M„-i) < +00 
whose points of increase are {xn,2, ■ ■ ■ , 2;n,M„-i}i from which the string m*^") may be constructed using 
equation (f6T]l . with Lq = Xn,i and Li = Xn,M„- 

Lemma 7.2. For any —00 < x < y < +00, there is a constant C{x,y) < +00 such that 

supm*(")((x Vx„,i,y Aa;„,M„)) < C{x,y) < +00 (79) 

n>l 

Proof of lemma 17.21 Assume not, then there exists a pair (x, z) such that —00 < x < z < +00 
and either an n > 1 such that m*^"\{x V Xn,2, ^ A Xn^MrS) = +00 or a subsequence {nj)j>i such that 
limj^+00 m*("j)((x V x„^.,i, z A x„^.,M„p) = +00. 

Assume the first case. Then there is an n > 1 and a point Xn,k £ (x, z), where 2 < k < AIn — 1, such 
that m*^^\{xn^k}) = +00. If x„^fc > eo(p*'"'^), then from equation (ITTIl . it follows that 

P < = eo(p("))) =1 Vt > 0, 

and, consequently //((— 00,2]) = 1 for some z < Xn,M„-i, contradicting the hypotheses on ^. 

If x„ < eo(p^"'^), then F (Xj > x„^fc|Xo = eo(p^"'^)) = 1 for Xn,k > 2;„^2) again a contradiction. 

Now consider the second case; suppose that for all (x',z') such that —00 < x' < z' < +00, m*^^\{x' V 
Xn,iTz' A Xn,M„)) < +00 for each n, but that there is a pair (x',z'), x' > Qo and z' < Qi and a 
subsequence (^^j)j>l such that limj_^+oo m*('*^^((x' V Xnj,i, z' A Xn^^Mn^ )) = 00. Let 

z = inf{z'| lim m*^"'^'^((x' V Xn - 1, z' A x„ , )) = 00} 

and, for this z, let 

X = lim ( sup{x'| lim m*("'^^((x' V x„ 1, (z + e) A x„ Af„ . )) = 00} ) • 

Note that x = z. Consider the representation X^") (s, x) = VF(r(")~^ (x, s), x) from definition [231 where 
is the inverse function of T^"'\x,s) = (p^^^s , z)m*^'^') (dz) . By the continuity of (/)(^), it follows 
that limj^+ooT('"i)(x,s) = +00 if </>(^)(s,5) > 0. If z > eo(/i), it follows that limj^+00 F(^f"''' > 
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= eo(p("^))) = and if i < eo(/i) then linij^+oo P(^J"'^ < = eo(p("^))) = 0, a 

contradiction in both cases. 

Lemma 17.21 is proved. □ 

Proof of theorem 12.91 (continued) Recall the definition of S in equation ([78]) . the set of points 
where ^ has an atom. Since ^ is a probability measure, there are at most a countable number of 
elements of <S. Note also that for each x G 5, there is an N such that for all n > A^, x = Xn^k„{x) for 
some kn{x). 

The remainder of the proof splits the string functions {A4^"''^)n>i into two parts, a part that con- 
verges by the Ascoli Arzela theorem to a continuous function and a part that converges to a function 
that increases by jumps. 

Set Xn,o = Xn,i - ^ and define yVJ^") by M^'^\xnfl) = and, for j = 0, 1, . . . , M„ - 1, 



-A4(")(x„j) X G [Xn,j,Xn,j+l], XnJ+l £ S. 



(n) 

Let M (x) = - >[(")(0). For -oo < X < y - 5 < +00, let 

^x,yiS) = limsup sup sup 

2e[a::n,iVx,x„_M„ Ay-5) 2<2'<2+<5 



n— >+oo 



Lemma 7.3. 



lim ex v(5) = V — cx3<x<u< +00. 



Proof of lemma 17.31 If limsup5_^o ^x,y{^) = c > 0, for some c > and some (x, y), then there is a 
sequence (x„^. , , 7W^"J^)j>i such that J, and such that there exists an x and y such that 

lim (>((''^')(x„, + - >f*^''^'^(x„,)) > c> 0, -00 < X < inf Xn, < supx„, <y < +00. 
Consider a limit point x* of x„^ . If x* ^ S", then 

lim P f X,^"^ = x*\Xq = eo fp^"))) = 0. 
If X* G 5 then, by the construction of there exists an such that for each N > n, 

P = x*\Xo = eo - /i({x*})| < (80) 

Note that 

P (xf") G [x* - <^,x* + 6]\Xo = eo 

= P (xf) = x*|xj") = eo + P (x(") G [x* - ,5,x* + <5]\{x*}|x(") = eo (p^")' 

and that 
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It follows that, in all cases, 



lim lim F(Xr ^[x* -6,x* +6]\{x*}\X'"' =eo(p'^''>]] =0. (81) 

<54,0 n-5>+oo V " \— / / 

The aim is to show that if liuis-^o ex,y{S) = c > 0, then equation (|8ip does not hold, leading to a 

contradiction. 

Set 

5(")(s,x) =p(xi") € [x* + J]\{x*}|xi") =2;) . 

Let be the element of D((y*(")) x !)((/*(")) from lemma ES] such that p(")(t;x,^) = 

/^g(")(t;x,y)m*(")(dy) for A G S((x„,i, a;„,AfJ). It follows that 

x„,k&[x*-S,x*+S]\{x*} 
If lim5_j.o e2i,^2(^) = c > 0, then for any x € (zi, 2:2), 



It holds that 



limliminf5(")(t,x) > climinf g(")(t;x,x*). (82) 

54,0 n— >-+oo n— !>+oo 

lim inf (t ; eo (p^") ) , x* ) = lim inf (t ; eo (/i) , x* ) . 

The following argument shows that liminf„^+oo g*^"'^(t; eo(^), x*) > 0, where the inequality is strict. 
If eo{n) < X*, let r(") = inf{s|xi"^ > x*} and = inf{x„,fc|x„,fc > x*}. If eo{fi) > x*, let t(") = 
inflslxi"^ < X*} and y* = inf{x„^fc|x„^fc < x*}. Then 

gW(i;eo(^),y;) = Tn^^") e c^sl^i") = eo(/i))g(")(t-s;y:,y:). 







It follows the construction that lim inf „_!.+oo q^'^\s; y*, y*) > 0; otherwise it follows from the construc- 
tion that liminf„_>+oo g^'^\s; y*, .) = and, using the fact that m*^'^\{xn,i V a, Xn,Mn ^ b)) < C{a, b) < 
+00, that lim inf n_!>+oo V^^\s; y*, (a V Xn,i, b A x„^m„)) = for all —00 < a < b < +00, a > Qo and 
^ ^ Qi) implying that there is a subsequence {nj)j>i such that \iinj^^oo'P^"'^\s;y^.,{QQ,Qi)) = 0, 
from which it follows that n{{Qo}) + fJ-{{Qi}) = 1, from which m*(")((Qo, Qi)) = for ah n > 1, 
which is a contradiction. 

It follows that lim^^o ^x,y{^) = for all —00 < x < y < +00 and the lemma is proved. □ 
Proof of theorem 12.91 (concluded) Recall that Qq = lim„_>.-|_oo x„ 1 and Qi = lim„_)._|_oo 

Xn,Mn- It 

follows, by the Arzelo-Ascoli theorem that for any — cxd < x < y < +00 satisfying x > Qo and y < Qi, 
there is a subsequence M and a limit point A^^,?/ such that 



lim sup 



Mx,y{z)-M {z) 
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For — oo<x<y<+oo, it follows from weak convergence and compactness arguments that there exists 

a subsequence {m*^"'''j\{z})\z E 5}, where {nkj)j>i is a subsequence of the {nj)j>i used for the contin- 

1 



uous part, and a limit point {9x,y{z)\z G S} such that for any /3 satisfying 



z < 



E 



ze5:x„ ,2<z<a;„, ,M„, -1 



Now let 



Define A^^; ^ as 



fx,y{z) 



2G5|Qo<2<Qi 



l+C(0,0V2)2+C{0Az,0)2 ' 



T.yje[o,z]ns^x,yH z>0 



Mx,yix) + fx,yix) Z<X 

MxAz) = { Mx,y{z) + fx,y{z) z G (x, y) 

, + fx,y{y) Z > y. 

Let be a limit point of Mx,y in the sense that there exists a sequence (xj, yj)j>i such that x, i — oo, 
yi t +00 and limi^+oo J 7{z){Mxi,y,{z) - M{z))dz = for all 7 such that / \j{z)\{l + C(z A 0,0)^ + 
C(0, z V 0)^)(iz < +00. Such a limit exists by the usual convexity and compactness arguments. 

Let m* denote the string measure constructed from A4 using equation (j6ip with Lq = Qq and 
Li = Qi- Then for each —00 < x < y < +00 such that Qo < x < y < Qi, hy construction, there is a 
subsequence (m**^"'-'^)j>i such that 



lim sup m*("j)((x VXn,,l,Z AXn,,M„J) -"T'*((x VQo,^ AQi)) 
^-'+°° ze[x,y] ' 



0. 



(83) 



Let rrix^J^^ be defined as the restriction of m*^"^ according to equation (j74p and X^")'^'^ the correspond- 
ing process according to equation (j73p ; similarly for ,^ and X^'^. Let {nj)j>i denote a sequence for 
which equation (l83l) holds. It follows from lemma ETT] that for any z G (x V Qo)?/ A Qi) and sequence 
Zn such that z„ . G (x V Qq, y AQi) for each j and z^^- — )• z. 



lim sup 



It also follows from the above description that, for any zi, Z2 G (QoiQi)) 



0. 



lim lim P(X;''^ < Z2|^o'^ 



ij,— CO 

and for any zi,Z2 G {xn,i,Xn,Mn) that 



^1. 



^(Xt < Z2\Xo = Zi). 



lim lim P(xf)'"'^<Z2|xi")'"'^ = zi) 



P(X^") < Z2\Xl 



in) 



Zlj 



Prom this, it follows that for any z G M and sequence {xj,yj) such that Xj J, —00 and yj t +00, there 
exists a subseqence inj)j>o such that 
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¥(Xt < z\Xo = eo(/u)) = lim F(Xp>''''"^' < z\Xp'''''''^' = eob^"^'^)) 

= lim F(xf < z\Xo = eo(p("^))) = ^((-oo, z]). 

and hence there exists a string measure m* and a gap diffusion X with infinitesimal generator ^^*^^ 
that satisfies 

P(Xt < z\Xq = eoifi)) = /u((-oo, z]) Vz G M. 

□ 

8 Conclusion 

For a given marginal distribution /i at a given fixed time t > 0, with a well defined expectation eo(/^), 
this article proves existence of a gap diffusion which, when started at cq at time 0, has this distribution 
at time t. The motivation for the problem that is currently receiving substantial attention, is from 
mathematical finance. It is described in the introduction; a list of call option prices for a given 
maturity t implies, at least approximately, a probability distribution for the stock price at maturity. 
For purposes of calibration, it is of interest to recover a time homogeneous equivalent martingale 
measure that produces this marginal distribution at the fixed time in question. 

The article gives existence in full generality for measures with compact support. The theorem of 
interest to practitioners is theorem 12.81 on a finite state space. Although the theorem only states 
existence, the crux of the problem is locating a vector A that satisfies equation (f27|) . For fixed r, 
this is a system of polynomial equations, each of degree r and algorithms exist for locating solutions. 
For fixed r, a solution provides a martingale that has the correct marginal for a time Tj. with T{r, ^) 
distribution. As r — )• +oo, the random variable Tj. approaches the deterministic time t; for all e > 0, 
lim^^+ooP(|T; -t\>e) = 0. 

It is the limit of /) = rA^*"^ that is of interest and hence a limit point, as r — )• +cxd of solutions to 

p = rT{pN^-' (=))• 

Suitable approximations to this problem should be achievable, since the structure of N is relatively 
straightforward. It is therefore possible that the ideas used here in the proof of existence may provide 
a method for estimating an appropriate martingale diffusion. 
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